System and method for reducing the number of ports associated with a mobile device

ABSTRACT

The technology presented here reduces the number of ports associated with the mobile device by combining a plurality of ports into a single multipurpose port. In one embodiment, the multipurpose port includes multiple sensors that detect various properties associated with a light beam, and a light guide that transmits the light beam between the environment outside and the multiple sensors inside the mobile device. In another embodiment, a multipurpose camera includes one or more pixels, different from the rest of the multipurpose camera pixels, where the one or more pixels receive a unique control signal. The unique control signal, sent by a processor coupled to the multipurpose camera, includes an instruction to perform an action different from the rest of the pixels, e.g., to turn on when the rest of the pixels are off. The active pixels can detect coarse properties of the light while saving mobile device battery life.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to the U.S. Provisional PatentApplication Ser. No. 62/249,130, filed Oct. 30, 2015, and to the U.S.Provisional Patent Application Ser. No. 62/317,474, filed Apr. 1, 2016,which are incorporated herein by reference in their entirety.

TECHNICAL FIELD

The present application is related to mobile devices and, morespecifically, to methods and systems that reduce the number of portsassociated with the mobile device, by combining functionality ofmultiple ports into a single multipurpose port.

BACKGROUND

Mobile devices contain a plurality of different ports, which correspondto a plurality of devices, such as the camera, the fingerprint sensor,the speakers, the microphone, the proximity sensor, the ambient lightsensor, etc. Each port requires a dedicated aperture formed in themobile device casing, a dedicated circuit on the motherboard, adedicated wiring between the hole in the mobile device casing and thecircuit on the motherboard, etc. Each additional port increases the costof manufacturing the mobile device. Further, each additional portincreases the probability of a foreign substance getting inside themobile device, such as dust or water, disrupting the operation of themobile device circuitry.

SUMMARY

The technology presented here reduces the number of ports associatedwith the mobile device by combining a plurality of ports into a singlemultipurpose port.

According to one embodiment, the multipurpose port includes multiplesensors that have previously required separate ports, such as aproximity sensor, an ambient light sensor, a camera, a range finder, afingerprint sensor, etc. The plurality of sensors detect variousproperties associated with a beam of light, such as color, intensity,and/or time of travel of the light beam. The multipurpose port furtherincludes a light guide to transmit a beam of light between theenvironment outside the mobile device and the multiple sensors insidethe mobile device. The light guide can take any shape, and thus enablesflexible positioning of the multipurpose port on the mobile device.

According to another embodiment, a multipurpose camera includes one ormore pixels different from the rest of the multipurpose camera pixels,where the one or more pixels receive a unique control signal. The uniquecontrol signal, sent by a processor coupled to the multipurpose camera,includes an instruction to perform an action different from the rest ofthe pixels, such as to turn on when the rest of the pixels are off. Byturning on one or more pixels when the remainder of the pixels are off,the active pixels can detect coarse properties of the light, such asambient light intensity, while saving mobile device battery life.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a multipurpose port disposed on a mobile phone, accordingto one embodiment.

FIG. 2 shows a placement of the multipurpose port inside the mobiledevice, according to one embodiment.

FIG. 3 shows the components of the light guide, according to oneembodiment.

FIG. 4 is a flowchart of a method to minimize a number of portsassociated with the mobile device, according to one embodiment.

FIG. 5A shows a sensor integrated into a mobile device multipurposecamera, according to one embodiment.

FIG. 5B shows a light guide integrated into a mobile device multipurposecamera, according to one embodiment.

FIG. 6 is a flowchart of a method to reduce a number of ports associatedwith a mobile device, according to one embodiment.

FIG. 7 shows the placement of various sensors close to the camera,according to one embodiment.

FIG. 8 shows a cross-section view of one or more sensors disposedproximate to the camera, according to one embodiment.

FIG. 9 is a diagrammatic representation of a mobile device in theexample form of a computer system 900 within which the above-describedapparatus may be implemented, and within which a set of instructions forcausing the machine to perform any one or more of the methodologies ormodules discussed herein may be executed.

DETAILED DESCRIPTION

The technology presented here reduces the number of ports associatedwith the mobile device by combining a plurality of ports into a singlemultipurpose port.

According to one embodiment, the multipurpose port includes multiplesensors, that have previously required separate ports, such as aproximity sensor, an ambient light sensor, a camera, a range finder, afingerprint sensor, etc. The plurality of sensors detect variousproperties associated with a beam of light, such as color, intensity,and/or time of travel of the light beam. The multipurpose port furtherincludes a light guide to transmit a beam of light between theenvironment outside the mobile device and the multiple sensors insidethe mobile device. The light guide can take any shape, and thus enablesflexible positioning of the multipurpose port on the mobile device.

According to another embodiment, a multipurpose camera includes one ormore pixels different from the rest of the multipurpose camera pixels,where the one or more pixels receive a unique control signal. The uniquecontrol signal, sent by a processor coupled to the multipurpose camera,includes an instruction to perform an action different from the rest ofthe pixels, such as to turn on when the rest of the pixels are off. Byturning on one or more pixels when the remainder of the pixels are off,the active pixels can detect coarse properties of the light, such asambient light intensity, while saving mobile device battery life.

In various embodiments the light guide can be an optical fiber cable, alight pipe, a liquid light guide, a sound guide or any materialconfigured to efficiently transmit a wave signal such as light and/orsound. Further, different sensors disclosed herein can be combined invarious ways, such as combining two or more sensors into a singlemultipurpose port.

Multipurpose Port

Presented here is a system and method configured to reduce the number ofports associated with a mobile device. A mobile device includes an outercasing, which includes a display area, a number of ports, a plasticcover, etc. The technology presented here reduces the number of portsassociated with the mobile device by combining a plurality of ports intoa single port.

FIG. 1 shows a multipurpose port disposed on a mobile phone, accordingto one embodiment. The port 100 includes an entry point disposed on theouter casing associated with the mobile device 110. The port 100 can bedisposed on the front, on the back, or on the sides associated with themobile device 110. The port 100 can comprise a plurality of portsdisposed anywhere on the mobile device 110, such as two ports disposedon opposite sides of the mobile device, six ports disposed on each sideof the mobile device, etc. The port 100 can be disposed on one or morepixels in a multipurpose camera 120 associated with the mobile device.The port 100 can be disposed proximate to the multipurpose camera 120.The entry point of the port 100 is configured to receive a first lightbeam and to emit a second light beam, where a frequency associated withthe first light beam and the second light beam spans the full frequencyrange of the electromagnetic spectrum.

FIG. 2 shows a placement of the multipurpose port inside the mobiledevice, according to one embodiment. FIG. 2 is the Y cross-section viewof the mobile device 110. Element 220 is the outer casing associatedwith the mobile device 110. Element 230 is the glass associated with themobile device 110, and element 240 is the touch display moduleassociated with the mobile device 110. The port 100 includes a lightguide 210, and a plurality of sensors 200, 205 associated with an exitpoint of the port 100.

The light guide 210 transmits a signal between an entry point 214 and anexit point 216 associated with the light guide 210. In variousembodiments disclosed herein, the light guide 210 comprises a tunnelthat transmits the signal between the entry point 214 and the exit point216. The signal can be any kind of a wave signal such as anelectromagnetic wave, and/or a sound wave. The light guide 210 comprisesa material that totally internally reflects the electromagnetic waveand/or the sound wave, such as acrylic resin, polycarbonate, epoxy,glass, etc. The entry point 214 is disposed on an outer surfaceassociated with the mobile device 110, while the exit point 216 isdisposed inside the mobile device 210.

According to one embodiment, the light guide 210 comprises a pluralityof light guides, such as a first light guide and a second light guide,where each component light guide can have a dedicated functionality, orfunction the same as other component light guides. The first light guidetransmits a first signal from the entry point 214 to a first sensor 200.The second light guide transmits a second signal from an emitterassociated with a second sensor 205 to the entry point 214. In anotherembodiment, the second light guide further transmits a third signal fromthe entry point 214 to a receiver associated with the second sensor 205.In various embodiments, the light guide 210 can be an optical fibercable, a light pipe, a liquid light guide, a sound guide or any materialconfigured to efficiently transmit the signal such as light and/or soundbetween the entry point 214 and the exit point 216.

The light guide 210 enables flexible placement of the entry point 214and the exit point 216. The light guide 210 can take on any shapeconnecting the entry 214 and the exit point 216 of the port 100. Theexit point 216, including the plurality of sensors 200, 205, can bedisposed on the circuit board associated with the mobile device 110,beneath the display associated with the mobile device 110, on a pixel ina camera associated with the mobile device 110, etc.

The light guide 210 can comprise a lens associated with either the entrypoint 214 or the exit point 216. The lens can be a short focal lengthlens, or a long focal length optical lens.

The plurality of sensors 200, 205 are coupled to the light guide 210.The plurality of sensors 200, 205 are configured to detect a pluralityof properties associated with the signal, such as a frequency, anintensity, a change in the frequency, a change in the intensity, a timeof flight associated with the signal, etc. The plurality of sensors 200,205 comprise at least two sensors, such as an ambient light sensor, aproximity sensor, a flash, a range finder, a fingerprint sensor, acamera, a speaker, and a microphone. The plurality of sensors 200, 205can emit and receive light. The emitted and received light can span thefull electromagnetic spectrum. For example, sensor 200 can be aninfrared range finding sensor.

According to one embodiment, the sensor 200 is an ambient light sensor200, and sensor 205 is a proximity sensor. The ambient light sensor 200is configured to detect a plurality of properties associated with thefirst light beam, such as color, intensity, change in color andintensity, gestures, etc. The proximity sensor 205 includes an emitterconfigured to emit the second light beam and a receiver configured toreceive the second light beam reflected off an object. The proximitysensor 205 is configured to measure a distance to the object, such as bymeasuring the time of flight for the emitted light, i.e., the timebetween the emission of the second light beam and measurement of thesecond light beam at the receiver associated with the proximity sensor205.

FIG. 3 shows the components of the light guide, according to oneembodiment. The light guide 210 can comprise component light guides 300,310, 320. Light guide 300 is configured to transmit the first light beamfrom the entry point of the port 100 to the ambient light sensor 200.Light guide 310 is configured to transmit the second light beam from theemitter associated with the proximity sensor 205 to the entry point ofthe port 100. Light guide 320 is configured to transmit a third lightbeam from the entry point of the port 100 to the receiver associatedwith the proximity sensor 205. The proximity sensor 205 can beconfigured to, based on the object proximity, detect gestures.

Each light guide 300, 310, 320 can have an optical lens 330, 340, 350,respectively, where the optical lens 330, 340, 350 is associated withthe entry point of the light guide 300, 310, 320. The optical lens 330,340, 350 can be associated with the exit point of the light guide 300,310, 320. The optical lens 330 associated with the ambient light sensorlight guide 300 can have a short effective focal length, i.e., the lens330 can be configured to focus light beams from a wide field of view.For example, the optical lens 330 can be a dome lens. The optical lens350 associated with the proximity sensor receiver light guide 320 canhave a long effective focal length, i.e., the lens 350 can be configuredto focus light beams from a narrow field of view. The lenses 330, 340,350 can comprise one or more lenses.

According to another embodiment, the light guide 210 can comprise twolight guides 300, 310. Light guide 300, same as above, transmits thefirst light beam to the ambient light sensor 200. Light guide 310 isconfigured to transmit the second light beam from the emitter associatedwith the proximity sensor 205 to the entry point of the port 100.Further, the light guide 310 is also configured to transmit a thirdlight beam from the entry point of the port 100 to the receiverassociated with the proximity sensor 205. The optical lens 330associated with the ambient light sensor guide 200 is the same asdescribed above. The optical lens 340 associated with the light guide310 can have a long effective focal length.

According to another embodiment, the light guide 210 can comprise onlyone light guide 300, configured to transmit the first light beam to theambient light sensor 200. The ambient light sensor 200 can be configuredto detect change in the ambient light, and based on the change in theambient light, the ambient light sensor 200 can detect the proximity ofan object.

FIG. 4 is a flowchart of a method to minimize a number of portsassociated with the mobile device 110, according to one embodiment. Instep 400, a light guide is provided and configured to transmit a beam oflight between an entry point 214 and an exit point 216, as describedabove. In step 410 a plurality of sensors, coupled to the light guide,is configured to detect a plurality of properties associated with thebeam of light. As described above, the plurality of sensors comprise atleast two of an ambient light sensor, a proximity sensor, a flash, arange finder, a fingerprint sensor, and a camera. The plurality ofproperties associated with the beam of light include a color associatedwith the beam of light, an intensity associated with the beam of light,a change in the color associated with the beam of light, a change in theintensity associated with the beam of light, and/or a time of flightassociated with the beam of light.

According to one embodiment, the light guide can comprise any one of ashort focal length optical lens and a long focal length optical lens.The light guide can be disposed on a pixel on a camera associated withthe mobile device.

In another embodiment, the light guide can be configured to transmitsound by shaping the light guide to totally internally reflect sound,and by making the light guide out of the material that tends to totallyinternally reflect sound. The light guide can be used to transmit soundonly, or the light guide can be used to transmit both sound and light.When the light guide is configured to transmit sound, the plurality ofsensors can include a microphone and a speaker.

According to one embodiment, the first light guide is provided where thefirst light guide includes a first tunnel configured to transmit a firstlight beam from the entry point 214 to a first sensor in the pluralityof sensors. A second light guide is provided including a second tunnelconfigured to transmit a second light beam from an emitter associatedwith a second sensor in the plurality of sensors to the entry point. Thesecond tunnel can be further configured to transmit a third light beamfrom the entry point to a receiver associated with the second sensor inthe plurality of sensors.

Multipurpose Camera

FIG. 5A shows a sensor integrated into a mobile device multipurposecamera, according to one embodiment. In FIG. 5A, only the rows of pixelsare labeled “500,” for brevity. The mobile device 110 comprises amultipurpose camera 120, shown in FIG. 1, and a processor coupled to themultipurpose camera 120. The multipurpose camera 120 comprises aplurality of pixels 500 that record an image, such as CCD or CMOSsensors. The multipurpose camera 120 comprises one or more pixels 510 inthe plurality of pixels 500, which are configured to receive a uniquecontrol signal. The one or more pixels 510 are configured to receive alight beam and transmit information associated with the light beam to aprocessor associated with the mobile device 110. The light beam can spanthe full electromagnetic spectrum and include wavelengths such asinfrared and visible light.

The unique control signal includes an instruction to perform an actiondifferent from a remainder of the plurality of pixels 500, such as toturn on while the remainder of the plurality of pixels 500 are turnedoff, to receive a beam of light, to send a beam of light, etc. Theunique control signal can come from a processor associated with themultipurpose camera 120, or the processor associated with the mobiledevice 110. The processor is configured to send the unique controlsignal to one or more pixels 510 via the I2C bus. The unique controlsignal can include an ID associated with the one or more pixels 510, andan instruction causing the pixel to turn on, to turn off, or to turn onin a specific mode, such as the ambient light sensor mode, a proximitysensor mode, etc.

The processor, coupled to the mobile device 110 and to the multipurposecamera 120, is configured to receive the information associated with alight beam, to detect a plurality of properties associated with thelight beam, and to detect changes in the plurality of propertiesassociated with the light beam. The plurality of properties includes afrequency associated with the light beam, an amplitude associated withthe light beam, a change in the frequency associated with the lightbeam, a change in the amplitude associated with the light beam, and/or atime of flight associated with the light beam. The frequency associatedwith the light beam spans the full electromagnetic spectrum. Theprocessor can further be configured to, based on the detected changes inthe plurality of properties associated with the light beam, determine atleast one of: a motion associated with an object, a gesture associatedwith an object, a proximity associated with an object, etc.

According to one embodiment, the plurality of pixels 500 is configuredto turn off to save power. Turning off can include the plurality ofpixels 500 not using any power, or the plurality of pixels 500 goinginto a standby mode where the pixels produce no readout. One or morepixels 510, in the plurality of pixels 500, are configured to detectambient light. The pixels 510 can be constantly on, while the rest ofthe pixels 500 are turned off, or can receive a unique control signal,as described above. By keeping only one pixel on, and turning the restof the pixels off, the mobile device 110 saves a significant amount ofpower. The one or more pixels 510 are configured to receive a light beamand transmit information associated with the light beam to a processorassociated with the mobile device 110.

According to another embodiment, the multipurpose camera 120 can act asa fingerprint sensor. The multipurpose camera 120 includes an outerlayer that detects contact between an object and the multipurpose camera120, the plurality of pixels 500 that record an image of the object, anda processor. The processor can be associated with the multipurposecamera 120, or the processor can be associated with the mobile device110. The outer layer can detect contact by detecting capacitance changesin the outer layer. Once the contact is detected, the plurality ofpixels 500 records an image of the object and sends it to the processor,such as via an I2C bus. The processor compares the image of the objectwith a stored image. When the recorded image matches the stored image,the processor authenticates the object. The match is performed within aspecified tolerance, such as the recorded image is authenticated whenthe recorded image matches the stored image to at least 95% accuracy.

FIG. 5B shows a light guide integrated into a mobile device multipurposecamera, according to one embodiment. The mobile device multipurposecamera 120 can be any camera associated with the mobile device, such asa front facing camera, a back facing camera, or a 360° camera. One ormore pixels 510 further comprise at least one light guide 520. The lightguide 520 comprises a material that totally internally reflects a beamof light. The light guide 520 comprises a tunnel that transmits thelight beam between one or more pixels 510 and the exterior of the mobiledevice 110. One or more pixels 510 are coupled to a processor configuredto send a unique control signal to the one or more pixels 510, where theunique control signal comprises an identification associated with theone or more pixels 510, and an instruction to perform an actiondifferent from a remainder of the plurality of pixels, the actioncomprising any of receiving a beam of light, sending the beam of light,an instruction to turn on, an instruction to turn off, an instruction toenter into a specific operation mode, etc.

According to one embodiment, the light guide 520 comprises a tunnel thatemits the beam of light and that receives a reflected beam of light, anda processor that detects the time of flight associated with a beam oflight. Frequency associated with a beam of light can span the fullelectromagnetic spectrum, such as infrared frequency, visible lightfrequency, etc. By detecting the time of flight, the processor canmeasure a distance to an object, thus acting as a range finderintegrated into the multipurpose camera 120, a proximity sensorintegrated into the multipurpose camera 120, etc.

According to another embodiment, the light guide 520 emits a flashlightto enable the plurality of pixels 500 to record the image. In thisembodiment, the flashlight is built into the multipurpose camera 120,thus enabling a front facing camera with a flash.

In another embodiment, one or more pixels 510 include an ambient lightsensor and a first light guide 520 coupled to the ambient light sensor.The first light guide 520 includes an entry point and an exit point, theexit point of the first light guide 520 coupled to the ambient lightsensor. The first light guide 520 is configured to receive the firstlight beam at the entry point and to transmit the first light beam tothe exit point. The ambient light sensor is configured to receive thefirst light beam and to detect a plurality of properties associated withthe first light beam. The plurality of properties associated with thefirst light beam includes color, intensity, and change in color andintensity. The ambient light sensor can be configured to, based on thedetected changes in the plurality of properties associated with thefirst light beam, determine at least one of: a motion associated with anobject, a gesture associated with an object, and a proximity associatedwith an object. In another embodiment, the processor can be configuredto, based on the detected changes in the plurality of propertiesassociated with the first light beam, determine at least one of: amotion associated with an object, a gesture associated with an object,and a proximity associated with an object.

According to another embodiment, one or more pixels 510, in addition tothe ambient light sensor and the first light guide 520, as describedabove, include a proximity sensor, and a second light guide 530 coupledto the proximity sensor. The proximity sensor includes an emitterconfigured to emit a second light beam and a receiver configured toreceive the second light beam reflected off an object. Further, theproximity sensor is configured to detect a distance to an object, suchas by measuring the time of flight for the emitted light, i.e., the timebetween the emission of the first light beam and measurement of thefirst light beam at the receiver associated with the proximity sensor.The second light guide 530 includes an entry point and an exit point.The exit point of the second light guide 530 is coupled to the emitterassociated with the proximity sensor. The second light guide 530 isconfigured to transmit a second light beam from the emitter associatedwith the proximity sensor to the entry point of the second light guide530.

According to one embodiment, the exit point of the second light guide530 can be coupled to the receiver associated with the proximity sensor.The second light guide 530 is configured to transmit the reflectedsecond light beam to the receiver associated with the proximity sensor.Alternatively, according to another embodiment, the one or more pixels510 include a third light guide 540 comprising an entry point and anexit point, the exit point of the third light guide 540 coupled to thereceiver associated with the proximity sensor. The third light guide 540is configured to transmit the second light beam reflected off an objectto the receiver associated with the proximity sensor.

FIG. 6 is a flowchart of a method to reduce a number of ports associatedwith a mobile device, according to one embodiment. In step 600, amultipurpose camera is provided, where the multipurpose camera includesa plurality of pixels that record an image. In step 610, one or morepixels in the plurality of pixels are configured to receive a uniquecontrol signal, the unique control signal including an identificationassociated with the one or more pixels, and an instruction to perform anaction different from a remainder of the plurality of pixels, such asreceiving a beam of light, sending the beam of light, etc. In step 620,a processor, coupled to the multipurpose camera, is configured to sendthe unique control signal to the one or more pixels and to detect aplurality of properties associated with the beam of light, such as afrequency associated with the beam of light, an amplitude associatedwith the beam of light, a change in the frequency associated with thebeam of light, and/or a change in the amplitude associated with the beamof light, etc.

According to one embodiment, the one or more pixels can include a lightguide, where the light guide comprises a material that totallyinternally reflects the beam of light. The light guide can be configuredto emit a flashlight to enable the plurality of pixels to record theimage.

According to another embodiment, the light guide can be configured toemit a beam of light and to receive a reflected beam of light. Theprocessor can be configured to detect a time of flight associated withthe beam of light, and as a result act as an infrared rangefinder, alaser rangefinder, a proximity sensor, etc.

In one embodiment, an outer layer detects a contact between an objectand the multipurpose camera. When the contact between the object and themultipurpose camera is detected, the plurality of pixels records theimage of the object. The processor compares the image of the object witha stored image. When the image matches the stored image, the processorauthenticates the object. This method can be used to authenticate a usersuch as by fingerprint recognition.

In another embodiment, an ambient light sensor is provided that receivesa first light beam and detects the plurality of properties associatedwith the first light beam, as described above. In addition, a firstlight guide is provided that includes an entry point and an exit point,where the exit point of the first light guide is coupled to the ambientlight sensor. The first light guide includes a first tunnel thatreceives the first light beam at the entry point, and that transmits thefirst light beam to the exit point.

According to one embodiment, a proximity sensor, configured to detect adistance to an object, is provided. The proximity sensor includes anemitter that emits a second light beam and a receiver that receives thesecond light beam. A second light guide is provided that includes anentry point and an exit point, the exit point of the second light guidecoupled to the emitter and the receiver associated with the proximitysensor. The second light guide includes a second tunnel that transmitsthe second light beam from the emitter associated with the proximitysensor to the entry point of the second light guide. Further, the secondtunnel transmits a third light beam from the entry point of the secondlight guide to the receiver associated with the proximity sensor, wherethe third light beam is the second light beam reflected off the object.

FIG. 7 shows the placement of various sensors close to the camera,according to one embodiment. Display 710 is associated with the mobiledevice 700, where the display 710 substantially covers a full side ofthe mobile device 700, and where the display 710 includes a notch 730.The notch 730 is cut out from a display stack associated with thedisplay 710. For example, when the display stack includes a color filterlayer, a liquid crystal display layer, and a thin film transistor layer,the notch 730 is cut out from the color filter layer, the liquid crystaldisplay layer, and the thin film transistor layer. For example, when thedisplay stack includes a color filter layer, a micro-electromechanicalsystems devices (MEMS) layer, and a thin film transistor layer, thenotch 730 is cut out from the color filter layer, the MEMS layer, andthe thin film transistor layer.

Camera 720 is associated with the mobile device 700, and placed insidethe notch 730 associated with the display 710. The notch 730 alsoincludes one or more sensors 740, 745, such as an ambient light sensor,a flash, a range finder, a fingerprint sensor, a camera, a speaker,and/or a microphone.

FIG. 8 shows a cross-section view of one or more sensors disposedproximate to the camera, according to one embodiment. Element 820 is theouter casing associated with the mobile device 800. Element 830 is theglass associated with the mobile device 800, and element 840 is thedisplay stack with a notch associated with the mobile device 800. Camera850 is placed inside the notch associated with the display stack 840,and beneath the glass 830. One or more sensors 860 include a light guide870. In one embodiment, a plurality of sensors 805, 810 are associatedwith an exit point of the light guide 870.

The light guide 870 transmits a signal between an entry point 880 and anexit point 890 associated with the light guide 870. In variousembodiments disclosed herein, the light guide 870 comprises a tunnelthat transmits the signal between the entry point 880 and the exit point890. The signal can be any kind of a wave signal such as anelectromagnetic wave, and/or a sound wave. The light guide 870 comprisesa material that totally internally reflects the electromagnetic waveand/or the sound wave, such as acrylic resin, polycarbonate, epoxy,glass, etc. The entry point 880 is disposed on an outer surfaceassociated with the mobile device 800, while the exit point 890 isdisposed inside the mobile device 800.

According to one embodiment, the light guide 870 comprises a pluralityof light guides, such as a first light guide and a second light guide,where each component light guide can have a dedicated functionality, orfunction the same as other component light guides. The first light guidetransmits a first signal between the entry point 880 and a first sensor805. The second light guide transmits a second signal between an emitterassociated with a second sensor 810 and the entry point 880. In anotherembodiment, the second light guide further transmits a third signalbetween the entry point 880 and a receiver associated with the secondsensor 810. In various embodiments, the light guide 870 can be anoptical fiber cable, a light pipe, a liquid light guide, a sound guideor any material configured to efficiently transmit the signal such aslight and/or sound between the entry point 880 and the exit point 890.

The light guide 870 enables flexible placement of the entry point 880and the exit point 890. The light guide 870 can take on any shapeconnecting the entry 880 and the exit point 890 of one or more sensors860. The exit point 890, including the plurality of sensors 805, 810,can be disposed on the circuit board associated with the mobile device800, beneath the display associated with the mobile device 800, on apixel in a camera associated with the mobile device 800, etc.

The light guide 870 can comprise a lens associated with either the entrypoint 880 or the exit point 890. The lens can be a short focal lengthlens, or a long focal length optical lens.

The plurality of sensors 805, 810 are coupled to the light guide 870.The plurality of sensors 805, 810 are configured to detect a pluralityof properties associated with the signal, such as a frequency, anintensity, a change in the frequency, a change in the intensity, a timeof flight associated with the signal, etc. The plurality of sensors 805,810 comprise at least two sensors, such as an ambient light sensor, aproximity sensor, a flash, a range finder, a fingerprint sensor, acamera, a speaker, and a microphone. The plurality of sensors 805, 810can emit and receive light. The emitted and received light can span thefull electromagnetic spectrum. For example, sensor 805 can be aninfrared range finding sensor.

According to one embodiment, the sensor 805 is an ambient light sensor805, and sensor 810 is a proximity sensor. The ambient light sensor 805is configured to detect a plurality of properties associated with thefirst light beam, such as color, intensity, change in color andintensity, gestures, etc. The proximity sensor 810 includes an emitterconfigured to emit the second light beam and a receiver configured toreceive the second light beam reflected off an object. The proximitysensor 810 is configured to measure a distance to the object, such as bymeasuring the time of flight for the emitted light, i.e., the timebetween the emission of the second light beam and measurement of thesecond light beam at the receiver associated with the proximity sensor810.

Computer

FIG. 9 is a diagrammatic representation of a computer system 900 withinwhich the above-described apparatus may be implemented, and within whicha set of instructions for causing the machine to perform any one or moreof the methodologies or modules discussed herein may be executed.

In the example of FIG. 9, the computer system 900 includes a processor,memory, non-volatile memory, and an interface device. Various commoncomponents (e.g., cache memory) are omitted for illustrative simplicity.The computer system 900 is intended to illustrate a hardware device onwhich any of the components described in the examples of FIGS. 1-8 (andany other components described in this specification) can beimplemented. The computer system 900 can be of any applicable known orconvenient type. The components of the computer system 900 can becoupled together via a bus or through some other known or convenientdevice.

This disclosure contemplates the computer system 900 taking any suitablephysical form. As an example and not by way of limitation, computersystem 900 may be an embedded computer system, a system-on-chip (SOC), asingle-board computer system (SBC) (such as, for example, acomputer-on-module (COM) or system-on-module (SOM)), a desktop computersystem, a laptop or notebook computer system, an interactive kiosk, amainframe, a mesh of computer systems, a mobile telephone, a tablet, apersonal digital assistant (PDA), a server, or a combination of two ormore of these. Where appropriate, computer system 900 may include one ormore computer systems 900; be unitary or distributed; span multiplelocations; span multiple machines; or reside in a cloud, which mayinclude one or more cloud components in one or more networks. Whereappropriate, one or more computer systems 900 may perform, withoutsubstantial spatial or temporal limitation, one or more steps of one ormore methods described or illustrated herein. As an example and not byway of limitation, one or more computer systems 900 may perform in realtime or in batch mode one or more steps of one or more methods describedor illustrated herein. One or more computer systems 900 may perform, atdifferent times or at different locations, one or more steps of one ormore methods described or illustrated herein, where appropriate.

The processor may be, for example, a conventional microprocessor such asan Intel® Pentium® microprocessor or Motorola PowerPC® microprocessor,or any type of microcontroller. One of skill in the relevant art willrecognize that the terms “machine-readable (storage) medium” or“computer-readable (storage) medium” include any type of device that isaccessible by the processor. The processor may be integrated with thecamera, or may be integrated with the mobile device.

The memory is coupled to the processor by, for example, a bus. Thememory can include, by way of example but not limitation, random-accessmemory (RAM), such as dynamic RAM (DRAM) and static RAM (SRAM). Thememory can be local, remote, or distributed.

The bus also couples the processor to the non-volatile memory and driveunit. The non-volatile memory is often a magnetic floppy or hard disk, amagnetic-optical disk, an optical disc, a read-only memory (ROM), suchas a CD-ROM, EPROM, or EEPROM, a magnetic or optical card, or anotherform of storage for large amounts of data. Some of this data is oftenwritten, by a direct memory access process, into memory during executionof software in the computer 900. The non-volatile storage can be local,remote, or distributed. The non-volatile memory is optional becausesystems can be created with all applicable data available in memory. Atypical computer system will usually include at least a processor,memory, and a device (e.g., a bus) coupling the memory to the processor.

Software is typically stored in the non-volatile memory and/or the driveunit. Indeed, storing an entire large program in memory may not even bepossible. Nevertheless, it should be understood that for software torun, if necessary, it is moved to a computer-readable locationappropriate for processing, and for illustrative purposes, that locationis referred to as the memory in this paper. Even when software is movedto the memory for execution, the processor will typically make use ofhardware registers to store values associated with the software, andlocal cache that, ideally, serves to speed up execution. As used herein,a software program is assumed to be stored at any known or convenientlocation (from non-volatile storage to hardware registers) when thesoftware program is referred to as “implemented in a computer-readablemedium.” A processor is considered to be “configured to execute aprogram” when at least one value associated with the program is storedin a register, readable by the processor.

The bus also couples the processor to the network interface device. Theinterface can include one or more of a modem or network interface. Itwill be appreciated that a modem or network interface can be consideredto be part of the computer system 900. The interface can include ananalog modem, ISDN modem, cable modem, token ring interface, satellitetransmission interface (e.g., “direct PC”), or other interfaces forcoupling a computer system to other computer systems. The interface caninclude one or more input and/or output (I/O) devices. The I/O devicescan include, by way of example but not limitation, a keyboard, a mouseor other pointing device, disk drives, printers, a scanner, and otherI/O devices, including a display device. The display device can include,by way of example but not limitation, a cathode ray tube (CRT), liquidcrystal display (LCD), or some other applicable known or convenientdisplay device. For simplicity, it is assumed that controllers of anydevices not depicted in the example of FIG. 9 reside in the interface.

In operation, the computer system 900 can be controlled by operatingsystem software that includes a file management system, such as a diskoperating system. One example of operating system software withassociated file management system software is the family of operatingsystems known as Windows® from Microsoft Corporation of Redmond, Wash.,and their associated file management systems. Another example ofoperating system software with its associated file management systemsoftware is the Linux™ operating system and its associated filemanagement system. The file management system is typically stored in thenon-volatile memory and/or drive unit and causes the processor toexecute the various acts required by the operating system to input andoutput data and to store data in the memory, including storing files onthe non-volatile memory and/or drive unit.

Some portions of the detailed description may be presented in terms ofalgorithms and symbolic representations of operations on data bitswithin a computer memory. These algorithmic descriptions andrepresentations are the means used by those skilled in the dataprocessing arts to most effectively convey the substance of their workto others skilled in the art. An algorithm is, here and generally,conceived to be a self-consistent sequence of operations leading to adesired result. The operations are those requiring physicalmanipulations of physical quantities. Usually, though not necessarily,these quantities take the form of electrical or magnetic signals capableof being stored, transferred, combined, compared, and otherwisemanipulated. It has proven convenient at times, principally for reasonsof common usage, to refer to these signals as bits, values, elements,symbols, characters, terms, numbers, or the like.

It should be borne in mind, however, that all of these and similar termsare to be associated with the appropriate physical quantities and aremerely convenient labels applied to these quantities. Unlessspecifically stated otherwise as apparent from the following discussion,it is appreciated that throughout the description, discussions utilizingterms such as “processing” or “computing” or “calculating” or“determining” or “displaying” or “generating” or the like, refer to theaction and processes of a computer system, or similar electroniccomputing device, that manipulates and transforms data represented asphysical (electronic) quantities within the computer system's registersand memories into other data similarly represented as physicalquantities within the computer system memories or registers or othersuch information storage, transmission, or display devices.

The algorithms and displays presented herein are not inherently relatedto any particular computer or other apparatus. Various general purposesystems may be used with programs in accordance with the teachingsherein, or it may prove convenient to construct more specializedapparatus to perform the methods of some embodiments. The requiredstructure for a variety of these systems will appear from thedescription below. In addition, the techniques are not described withreference to any particular programming language, and variousembodiments may thus be implemented using a variety of programminglanguages.

In alternative embodiments, the machine operates as a standalone deviceor may be connected (e.g., networked) to other machines. In a networkeddeployment the machine may operate in the capacity of a server or aclient machine in a client-server network environment, or as a peermachine in a peer-to-peer (or distributed) network environment.

The machine may be a server computer, a client computer, a personalcomputer (PC), a tablet PC, a laptop computer, a set-top box (STB), apersonal digital assistant (PDA), a cellular telephone, an iPhone, aBlackberry, a processor, a telephone, a web appliance, a network router,switch or bridge, or any machine capable of executing a set ofinstructions (sequential or otherwise) that specify actions to be takenby that machine.

While the machine-readable medium or machine-readable storage medium isshown in an exemplary embodiment to be a single medium, the term“machine-readable medium” and “machine-readable storage medium” shouldbe taken to include a single medium or multiple media (e.g., acentralized or distributed database, and/or associated caches andservers) that store the one or more sets of instructions. The term“machine-readable medium” and “machine-readable storage medium” shallalso be taken to include any medium that is capable of storing, encodingor carrying a set of instructions for execution by the machine, wherethe set of instructions causes the machine to perform any one or more ofthe methodologies or modules of the presently disclosed technique andinnovation.

In general, the routines executed to implement the embodiments of thedisclosure may be implemented as part of an operating system or aspecific application, component, program, object, module, or sequence ofinstructions referred to as “‘computer programs.’” The computer programstypically comprise one or more instructions set at various times invarious memory and storage devices in a computer, and that, when readand executed by one or more processing units or processors in acomputer, cause the computer to perform operations to execute elementsinvolving the various aspects of the disclosure.

Moreover, while embodiments have been described in the context of fullyfunctioning computers and computer systems, those skilled in the artwill appreciate that the various embodiments are capable of beingdistributed as a program product in a variety of forms, and that thedisclosure applies equally, regardless of the particular type of machineor computer-readable media used to actually effect the distribution.

Further examples of machine-readable storage media, machine-readablemedia, or computer-readable (storage) media include, but are not limitedto, recordable type media such as volatile and non-volatile memorydevices, floppy and other removable disks, hard disk drives, opticaldiscs (e.g., Compact Disk Read-Only Memory (CD-ROMS), Digital VersatileDiscs (DVDs), etc.), among others, and transmission type media such asdigital and analog communication links.

In some circumstances, operation of a memory device, such as a change instate from a binary one to a binary zero or vice-versa, for example, maycomprise a transformation, such as a physical transformation. Withparticular types of memory devices, such a physical transformation maycomprise a physical transformation of an article to a different state orthing. For example, but without limitation, for some types of memorydevices, a change in state may involve an accumulation and storage ofcharge or a release of stored charge. Likewise, in other memory devices,a change of state may comprise a physical change or transformation inmagnetic orientation or a physical change or transformation in molecularstructure, such as from crystalline to amorphous or vice versa. Theforegoing is not intended to be an exhaustive list in which a change instate for a binary one to a binary zero or vice-versa in a memory devicemay comprise a transformation, such as a physical transformation.Rather, the foregoing is intended as illustrative examples.

A storage medium typically may be non-transitory or comprise anon-transitory device. In this context, a non-transitory storage mediummay include a device that is tangible, meaning that the device has aconcrete physical form, although the device may change its physicalstate. Thus, for example, non-transitory refers to a device remainingtangible despite this change in state.

Remarks

The language used in the specification has been principally selected forreadability and instructional purposes, and it may not have beenselected to delineate or circumscribe the inventive subject matter. Itis therefore intended that the scope of the invention be limited, not bythis Detailed Description, but rather by any claims that issue on anapplication based hereon. Accordingly, the disclosure of variousembodiments is intended to be illustrative, but not limiting, of thescope of the embodiments, which is set forth in the following claims.

The invention claimed is:
 1. A camera comprising: an imaging devicecomprising a plurality of pixels, the plurality of pixels operable to beturned off to save power; a first pixel in the plurality of pixelsoperable to turn on when the other pixels in the plurality of pixels areturned off, and when the other pixels in the plurality of pixels areturned off, the first pixel operable to receive a first light beam, thefirst pixel comprising: an ambient light sensor operable to receive thefirst light beam, and detects a plurality of properties associated withthe first light beam, the plurality of properties comprising a frequencyassociated with the plurality of light beams, an amplitude associatedwith the plurality of light beams, a change in the frequency associatedwith the plurality of light beams, and a change in the amplitudeassociated with the plurality of light beams; a first light guidecomprising an entry point and an exit point, the exit point of the firstlight guide positioned proximate to the ambient light sensor, the firstlight guide comprising a first tunnel operable to receive the firstlight beam at the entry point, and operable to transmit the first lightbeam to the exit point; and a processor operable to send a uniquecontrol signal to the first pixel, the unique control signal comprisingan identification associated with the first pixel, and any one of aninstruction to turn on or an instruction to turn off.
 2. The camera ofclaim 1, said first pixel further comprising: a proximity sensoroperable to detect a distance to an object, the proximity sensorcomprising an emitter operable to emit a second light beam, and areceiver operable to receive the second light beam reflected off theobject; a second light guide comprising the entry point and the exitpoint, the exit point of the second light guide coupled to the emitterassociated with the proximity sensor, the second light guide comprisinga second tunnel operable to transmit the second light beam from theemitter associated with the proximity sensor to the entry point of thesecond light guide; and a third light guide comprising the entry pointand the exit point, the exit point of the third light guide coupled tothe receiver associated with the proximity sensor, the third light guidecomprising a third tunnel operable to transmit a third light beam fromthe entry point of the third light guide to the receiver associated withthe proximity sensor, the third light beam comprising the second lightbeam reflected off the object.
 3. The camera of claim 1, the processor,based on the detected changes in the plurality of properties associatedwith the first light beam, operable to determine any of a motionassociated with an object, a gesture associated with the object, and aproximity associated with the object.